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ABSTRACT 


. this ‘paper describes the ébepeeds ‘taken at the teagan 
Institute of Technology (OIT) for the “evaluation of its faculty in 
conjunction with the OIT administrator evaluation methods. A set ‘of 
Annual Faculty Objectives (AFO) .are established by*both faculty and 
department chairmen. They review Mivisional and departmental goals 

ang agree on specific objectives .to be accomplished in a given year. 
These objectives reflect four primary functions: 1) instruction, 2)- 
professional development, 3) institutional service, and 4) public 5 
service, The form used for this evaluation is preseated in this ° er 
paper. A description of the Paculty Annual Merit Evaluation PANES 


WETTTITITITI TIT TTT ttt 


Documents acquired by ERIC include many informal unpublished s: 


* 

* materials not available from other sources. ERIC makes every effort’ * 
* to obtain the best copy available. Nevertheless, items of marginal 

* reproducibility are often encountered and this ‘affects the quality 

* of the microfiche and hardcopy reproductions ERIC makes available 
* 
* 
* 
* 


responsible for the quality of the original document. Reproductions 


* 
* 
* 
via the ERIC Docusent Re production Service (EDRS). EDRS is not : * 
* 
supplied by EDRS are the best that can be made from the original. * 


PREREEREE ERASE OER EK EER EREAEAE EEE AREER ESESE SHEERS ERERES HES EKEEEEEEEESEEE 


SE Oa Jas 


~ 


ED124399 


US DEPARTMENT OF HEALTH 
" EOUCATION & WEL FASE 
NATIONAL INSTITUTE OF 


EDUCATION Prine ae 
7 = bs 
~ 
id ; THIS DOCUMENT HAS BEEN REPRO: 
OUCED EXACTLY ZS RECEIVED FaQnu oo 
THE PERSON OR ORGANIZATION OR IGIN- - 
ATING vw Po NTS OF VIEW O8 OPINIONS t 


STATED DO'NOT NECESSARILY MEPRE 
SENT OFFIC AL NATIQNAL STITUTE OF 
EDUCATION POSIT qe OR POLIEY 


Event Number 4250 : 
' . ; x : r . ' 
AMERICAN SOCIETY FOR ENGINEERING EDUCATION 
ANNUAL CONFERENCE, JUNE 16-19, 1975 
COLORADO STATE UNIVERSITY = 
ies _ FT. COLLINS, CO 80521 pe 
: . , * x " . 
FACULTY ANNUAL MERIT EVALUATION 
AT: 
OREGON INSTITUTE OF ‘TECHNOLOGY 
; by” | 
=e 7 ’ >. 
- VYohn G. Ward 
F i Dean of Academic Affairs a 
a\ J: : ee 
a : Oregon Institute of Technology 
Klamath Falls, OR 97601 
R 
= 


FACULTY ANNUAL MERIT EVALUATION 
OREGON: INSTITUTE: OF TECHNOLOGY 

What Should facul ty evaluation accomp]ish on your “campus? $ 
Clarify values? Communicate expectations? Make visible criteria ° 
and ‘procedures? ‘Enhance ‘consistency? Recognize excellence? 

Over die rast twenty-five ears Pregon Institute of Technology 
has ~developed faculty evaluation to accomplish these. and other goals. 
Teaching and administrative faculty widely supper’ the present 
approach, It yenaniees effective teaching by favsity with-up-to- 

date ‘knowledge and contributing reaavrable Jeotetuttonal and public 
‘service. It ‘complements OIT administrator evaluation methods and 
has proven useful] fdr faculty with split administrative-teaching 
appointments. And it has not required undue time, typically three 
hours per year for each faculty member. 
Annual Faculty Objectives 

“O1T 4s committed to evaluating accomplishment in terms of . 
objectives: set annually between faculty and department chairman. 
They review divisional and ‘departmental goats and agree on specific 

objectives be accomplished that academic year. These Annual — 
Faculty Objectives (AFO). reflect the four primary functions which 
“Oregon's Administrative Rules specify for Rye eat iiggeeiey 

instruction, prods ional development, institutional service and 


public service (1). The form used to record AFO's,; presented on 


the next page,.is reported by department chairmen to require about 
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: * -Note objectives where approval ,opportun{ty,or funding was unavailable. 
AGREED ACTION budget | completion® wore major results agreed on reached? To what extent and how weJl? ~ 
2 ee date -Were there problems in getting results? what action was taken? 
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Associate _- ASSOCIATE DEAN: Return original to Dean's office. These will be 
Dean returned for departhental review in Spring 1974-75, Fall 1975-76 
% and for evaluation in Winter/Spring 1975-76. 
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one hour to complete during their fall conferences. 
Facuity Annual Merit Evaluation 
Faculty Annual Merit evalmntian (FAME) conferences occur during 
spring quarter. The FAME form, printed on the revetss of the AFO 
form, is returned to chairmen with each [faculty setbar's file. Docu- Ae 
ments such as eeudant evaluations, committee assignments, reports of oe 
travel and siredosetonat activity, and comfendations are included for “- 
review. Typically chatymen spend about one -hour preparing for the 
evaluation conference, and another hour discussing results achiewd 
. 
and compheting the FAME form This document, presented onthe next 
page, summarizes varied input from many sources into a composite 
evaluation for that academic year: It evolved to: 
. Emphasize teaching was valued over research and service. 
Establish factors and weights with visibleawi teria and procedures. . 
Communicate qualitative performance expected , 
. Enhance consistency and equity between farcilty ~ 
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*. Direct attention and effort to ihsti tutional objectives. 

. Provide tangible summary of accomp1ishment. 

The FAME form provides basic information for review and decisions 
involving reappointnent, merit eatin increase, sant promotion, and 
tenure. Though some of the FAME information may find use diagnostically 
to identify possible improvement areas, OIJ attempts to keep this 
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function Separate. Diagnostic evaluation seems more related ‘to faculty 
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~ FACULTY ANNUAL MERIT EVALUATION | danual 


INSTRUCTION Merit 


cLassnoom ¢ 108 
TEACHING 


little interest routine prep. thorough prep. top level prep. 

in instructional usual lecture & new mati. always highly innovative 
process outline approach develops B0's exce}lent BO's & 
: generally up-to-date notable lab use lect/lab integration 
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TEACHING OBJECTIVES Cc] 


accomp] ished accomp! ished Supertor accomplishment, 
most objectives all objectives on very difficult > 
moderate dj fficulty exceeded on some objectives 
= often late prompt, well done 


. 50 : 7 

weLP — ae? 
> : generally outstanding : 

: informed & advisor - 


available always willing 
fair rapport & able to help 
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STUDENT SURVEY 


fair rating mostly good very good wy, exceptional 
biased, or poor student reaction student rating Fh rating 


preparation interesting lect. encourages students * sensitive & 
not helpful tests fair » very helpful stimulating 


InsTRUCTION SUPPORT ‘ 
% () 200 
PROFESSIONAL DEVELOPMENT 
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INSTITUTIONAL SERVICE 
ps 100 Wours 


. ° 5 
PROFESSIONALLY - RELATED 
PUBLIC SERVICE 50 HOURS 


r Department Chairman Comment 


+ < RECOMMENDATION: 
Eligible for Promotion in Rank? es . 7 
* No : Salary increase of plases 


- —_—— 
date: __ Faculty Member date; Department Chairman 


Associate Dean Comment 
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development and often produces information inappropriate for adminis- 
trator use in personnel decision making. Philosophically OIT focuses 
on evaluating faculty strength following. development, rather than 


locating weakness. 


The evaluation categories on the FAME form were developed by 


Faculty Senate committees. These experienced teachers realized 


isolating an’ individual's contribution fo student learning was ex- 
traordinarily. difficult. Any selection seemed to involve proxies, 

but they setected what were thought the most important and ‘appropriate a. 
measures for oIT. Seven categories were selected for evaluation. ; 
Four, relating to instruction, included classroom and laboratory 

teaching, teaching objectives, help to students, and student survey 

results. -Instructional support activities which include professional 
development, institutional service, and professionally-related public 


service form the remainder-of the evaluation. 
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The neronting assigned each category ‘was established following 
experimental use in eleven of sixteen instructional departments. 
Principal modifications included a five percent decrease eSeh in 
"classroom and Jaboratory teaching," and "student ives with ten 
percent added to "teaching objecttves." 
Administering "FAME" 

Department ghaiwian piay a critical role in evaluating faculty 


using the FAME system. Since fifty-five-percent of the evaluation 
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depends on Skeoimtiahied Annual Faculty Objectives, chairmen quickly 
learn how they should be written. Specific measurable tasks soon * 
replace vague statements. ‘Clarification of departmental goals and 
increased delegation occurs. Both chairman and faculty keep more 
accurate records. The sources ‘and kinds of information’ collected 

and general administrative procedures for the various ‘categories 

are described in the following sections. 77% a 
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Classroom and Laboratory Teaching. 2 meee _ . . 
Department. shateath are responsible for consoPidating data, © ‘ 

from several sources to judge the individual's teaching — 

in the classroom and laboratory. This® category comprises twenty 

percent of the evaluation. Day-to-day observation of coursework | if. d 7 

preparation and laboratory activity gives direct information on 

interest taken in the fnstructional process. Faculty provide copies 

of course outlines, performance objectives, tidy and laboratory 

Nutdes and manuals, reading lists, examinations, and other instruc- 

tional materials for review. Requests for film rental, purchase . : \ 

of instructional equipment, supplies, and media ware give additional as 

evidence of teaching jmprovement. 

In a few departments classroom visitation by: the deateman provides 
supplementary information on teaching performance and an spporeunity 
for later discussion about teaching and teaching ‘strategy. Such visits 
occur with the instructor's consent at a mutually agreed time, .most 


often at the instructor's request. 


Opinion from faculty in other departments, special consultants, 


visiting teams, and advisory boards is sometimes available. When, 
the chairman feels there is sufficient firsthand familiarity for 
"reliable judgment, such data is included in the comenette assessment. 
Teaching Objectives. . . : 
tn addition to day-to-day teaching responsibility, faculty mem- 

bers annually establish special objectives for teaching improvement. 

"Accomplishment of teaching objectives is weighted at fuenty percent. 

From a dean's viewpoint, the varied objectives show refreshing stimu- 
lation and vitality. Most teaching objectives relate to departmental 
plans for curricular change designed to assure graduates with necessary 
skills. Study and development of revised performance specifications ,. . a 
laboratory revision and improvement, and devehmaanl of new courses \ 
‘and learning center materials are examples of these. Self evaluation 
and the development of different presentation techniques appear often, 
| as does improvement in specific areas of student evaluation. Some 


‘ latitude is needed by’ chairmen in determining when such activities 


ASti tute professional development. “os 
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Five percent weighting is given for out-of-class academic assis- , 
tance given students. Informa] observation and student comment are 

the primary inputs now available to department chairmen. Committee 


work is proceeding to determine less casual procedures especially 
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regarding contributions by academic advisors. 
Student Survey. oa ; oa 

Student evaluation of -all faculty in all courses occurs. at least 
one quarter during the year, An insti tution-wide sixteen-item OIT ' 
Survey instrument is used-with results made available to the faculty 
member and department chairman. The tabulated data i$ summarized and 
statistically sha lysed for each item. In addition, a graphical pre- 
sentation based on a single global item is included showing that . 
faculty member's. evaluation in that course compared to all other . 
departmental members, all members within the division, and the entire \ 
faculty for that jiaiker. Faculty may request student evaluation 
in any course, and retain the results or add them to their personal 
file. Faculty may also select lup to twenty diagnostic survey ques- 
tions from a bank of seventy questions; these results are returned 
directly to the individual for personal use. 

Department chairmen review ie ees avatlable in the 
- faculty member's file, and judge an appropriaté point total. Up to 

twenty percent of the total evaluation is based on student survey 

results. ? 
Professional Development. 

Faculty:development has long been emphasized at OI. Present — 
policy is that each faculty member must show the equivalent of 


twelve-weeks continuing professional development during each three- 
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year period. The FAME system recognizes the first ane hours: 
spent on professional growth during any yea, corresponding to a, 
twenty percent weighting. Guidelines have been developed on activities 
to be considered, together with a qualitative weighting for such 


activities as- professional reading. _ Department chairmen list and 


-review each ue activity in relation to objectiyes set earlier. 


The diversity ef faculty actttey in teaching, state- ot the-art, and’ 


errno ar professional development which ineluge: engineering, 


‘a4 


industrial, and allied health technologies, and all manner of arts 
and sciences, is simply staggering. Possibly no aspect of FAME use 
stimulated faculty more han protec stohal deve lopment. And faculty 
requests have forced development of broader opportunsty and increased 
staff career suppért. ‘ 

fnstitutional Service. 

A ten percent weighting is given ‘contribution of committee, com- 
mission, and taskforce activity by faculty. Advising student social 
and professional ofaanizationss and performing administrative work 
within departments. is also recopritzed here. Department chairmen list 
and review such activities, and award points for the first one hundred 
hours of service contributed. Studies are proceeding to identify 
methods by which aust tative dudeswnts can be improved. ‘Presently 


little input from committee chairmen reaches the department chairman. 
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Professionally-Related Public Service. 


The five percent weighting given public service, and the defin- 
ition of "professionally-related" have without doubt attracted more 
faculty comment than any other category. A ah iger enon committee . 

imply ‘could not satisfy the value judgments of the entire faculty. . 
However, guidelines are available which chairmen use in judiciously 
‘assigning up to five percent of the points for the first fifty hours 
of contributed -public service 

Observations on "FAME" : a 

FAME oparently satisfies fore faculty, heen teacher or 
administrator, than any approach previously used Evaluation criteria 
varied Widely or were difficult to discover. Department chairmen 
much avatar the structured consistent approach and report it a useful 
planning std. Faculty sohienlate the recognition received for pro- 
fessional improvement and service to the campus and civic community: 


— 


Faculty appear to Support. the categories selected. When FAME — 

«was in an advanced draft stage, the Teaching Research Division of the 
Oregon State System of Higher Education began a System-wide study on 
Assessing Faculty Performance. The campus susivete phase included , 
studies on thirty-three factors which faculty sappelued to be important i _ 
in evaluation for promotion and tenora, contrasted to factor’s they 


preferred for evaluation. This third-party study identified many 


. a 
factors OIT faculty preferred for evaluation; the top six baséd on : 
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;, ae 
rank order’ are listed in Table I (2). Five of the six were already 


represented in.the FAME format. °s. ; * 
‘ Table Te TOP SIX EVALUATION FACTORS PREFERRED BY OIT FACULTY 
Preference neder ce > ane 
Innovative effort in teaching. 
3 Evidence of student learning. 
‘Effort to rena current in discipline. 
Evaluation by “department chai rman. 
Support of departmental policy and goals. 


-. Student rating of instructor performance. 


B FAME dncludes ‘evaluation in two categories ‘the faculty prefer. be 
"given “slight consideration in proinotion and tenure: departmental, 
‘ ingtitiitional, and system-wide committee work; and service to Tocal 
7 and/or state comin ty. Another category--help to students --was 
not gne of i al di rectly studie#, though several items ue 
as "availability to students," and "advising undergriduates" were 
included. None of thé 4 measures for out-of-claspracademic 
assistance to stude s were strongly ‘preferred evaluation factors» * 
The low weighting -FAME ae these factors is consistent with OIT 
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facul ty’ ‘preferences. F ; ‘ : ; \ 


Implementation of both the anil Faculty ‘Objectives land: pe. 


sequent Faculty Annual Merit Evaluation occurred with scarcely any 


s 


of ‘service | 


hegative comment. FAME use has stimulated contribution, 


to the insti tution and the community, and-significantly increased 
professioMl development activity. But the benefit most frequently 


mentioned is "Now I know what's expected and where I stand." 
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